The Model-Based Systematic Development of LOGIS Online Graphing Instructional Simulator

............................................................................................................................. xi Chapter One Introduction.................................................................................................... 1 Chapter Map............................................................................................................ 1 Motivation............................................................................................................... 1 Practical Motives......................................................................................... 1 Research Motives........................................................................................ 3 Focus of the Study................................................................................................... 4 Research Questions ................................................................................................. 4 Significance of the Study........................................................................................ 5 Acronyms and Definition of Terms ........................................................................ 6 Summary................................................................................................................. 8 Chapter Two Review of the Literature ............................................................................... 9 Chapter Map............................................................................................................ 9 Developmental Research....................................................................................... 10 Historical Perspective ............................................................................... 11 The Nature of Developmental Research................................................... 13 Issues and Challenges in Developmental Research.................................. 18 Why Conduct Developmental Research? ................................................. 19 Learning ................................................................................................................ 20 What is Learning? ..................................................................................... 20 Experience and Learning .......................................................................... 24 ii Attitudes and Learning.............................................................................. 27 Learning Outcomes ................................................................................... 31 Intellectual Skill ............................................................................ 32 Discriminations. ................................................................ 32 Concepts............................................................................ 32 Rules and principles.......................................................... 33 Problem solving. ............................................................... 33 Cognitive Strategy......................................................................... 33 Verbal Information........................................................................ 33 Attitude ......................................................................................... 34 Motor Skill .................................................................................... 34 Relating Learning Perspectives to Instruction.......................................... 34 The Assessment of Learning..................................................................... 35 Instruction ............................................................................................................. 37 Programmed Instruction............................................................................ 37 Skinner .......................................................................................... 37 Instructional Characteristics.......................................................... 39 Prompts. ............................................................................ 41 Fading. .............................................................................. 42 Copy frames. ..................................................................... 42 Priming. ............................................................................. 42 Research on PI .............................................................................. 44 Overt Versus Covert Responses.................................................... 45 Constructed Response vs. Multiple-Choice.................................. 47 Confirmation................................................................................. 48 Current and Future Research......................................................... 49 Adaptive Instruction.................................................................................. 51 Micro-Adaptive Instructional Models........................................... 53 Intelligent Tutoring Systems ..................................................................... 59 Simulations ............................................................................................... 60 What is a Simulation? ................................................................... 60 Games, Virtual Reality and Microworlds..................................... 62 Types of Simulations .................................................................... 64 Advantages and Disadvantages of Simulations ............................ 66 iii Are Simulations Effective? ........................................................... 68 Why use a simulation.................................................................... 72 The Design of Instruction ......................................................................... 73 What are Instruction and Design? ................................................. 73 Instructional Systems Design........................................................ 75 A Systematic Approach ................................................................ 76 ADDIE ...................................................................................................... 78 The ADDIE Phases ....................................................................... 79 Why use ADDIE? ......................................................................... 81 Graphing ............................................................................................................... 81 Summary............................................................................................................... 87 Chapter Three Proposed Development ............................................................................. 89 Chapter Map.......................................................................................................... 89 Research Questions ............................................................................................... 90 The ADDIE Model................................................................................................ 91 Analysis Phase .......................................................................................... 92 Analysis Component 1 .................................................................. 92 Analysis Component 2 .................................................................. 93 Analysis Component 3 .................................................................. 95 Analysis Component 4 .................................................................. 96 Design Phase............................................................................................. 98 Design Component 1..................................................................... 98 Design Component 2..................................................................... 98 Design Component 3................................................................... 100 Design Component 4................................................................... 101 Design Component 5................................................................... 103 Design Component 6................................................................... 104 Development Phase................................................................................. 105 Development Component 1 ........................................................ 105 Development Component 2 ........................................................ 105 The LOGIS interface....................................................... 105 The LOGIS development process. .................................. 110 The Knowledge Assessment development. .................... 114 iv The Skills Assessment development. .............................. 124 The Survey development. ............................................... 129 Threats to assessment validity......................................... 134 Threats to the survey validity .......................................... 136 Development Component 3 ........................................................ 136 Development Component 4 ........................................................ 136 Development Component 5 ........................................................ 137 Implement Phase..................................................................................... 137 Implement Component 1............................................................. 137 Implement Component 2............................................................. 137 Evaluate Phase ........................................................................................ 137 Evaluate Component 1 ................................................................ 137 Evaluate Component 2 ................................................................ 139 One-to-One Evaluation ................................................... 140 Small-Group Evaluation ................................................. 142 Field Trial........................................................................ 144 Evaluate Component 3 ................................................................ 145 Summary............................................................................................................. 145 Chapter Four Actual Development ................................................................................. 146 Chapter Map........................................................................................................ 146 Research Questions ............................................................................................. 148 Analysis Phase Report and Reflection................................................................ 148 Analysis Phase critique ........................................................................... 151 Design Phase Report and Reflection................................................................... 152 Design Phase Critique ............................................................................. 157 Development Phase Report and Reflection ........................................................ 158 The interface and the application............................................................ 158 Tutorial Development ............................................................................. 171 Knowledge Assessment Development.................................................... 173 Skills Assessment Development ............................................................. 184 Survey Development............................................................................... 189 Graphing Proficiency Test Development................................................ 204 Descriptive Information From The One-To-One Evaluation ................. 206 v Descriptive Information From The Small-Group Evaluation................. 210 Development Phase Critique................................................................... 210 Implement Phase Report ..................................................................................... 211 Implement Phase Critique ....................................................................... 212 Evaluate Phase Report ........................................................................................ 212 Evaluate Phase Critique .......................................................................... 213 Summary............................................................................................................. 213 Chapter Five Conclusions ............................................................................................... 215 Chapter Map........................................................................................................ 215 Research Question 1............................................................................................ 216 Organization............................................................................................ 217 Time ........................................................................................................ 221 Perspective .............................................................................................. 223 Research Question 2............................................................................................ 225 General Reflection.............................................................................................. 227 Future Direction.................................................................................................. 230 References....................................................................................................................... 232 Appendices...................................................................................................................... 240 Appendix A: The tutorials and major goals ....................................................... 241 Appendix B: Guidelines for the development of the alternate-choice items ..... 243 Appendix C: Checklist for the development of the alternate-choice items ....... 244 Appendix D: Guidelines for the development of the multiple-choice items ..... 245 Appendix E: The print format guidelines .......................................................... 246 Appendix F: Checklist for the development of the multiple-choice items ........ 247 Appendix G: Guidelines for the development of the short-answer items .......... 249 Appendix H: Checklist for the development of the short-answer items ............ 250 Appendix I: Checklist for the development of the Skills Assessment items ..... 251 Appendix J: Guidelines for the development of the survey items ..................... 252 Appendix K: Checklist for the development of the survey items ...................... 253 Appendix L: Table key and Wrong Responses for each Frame of each Tutorial Task....................................................................................................... 254 vi Appendix M: The final version of the items in the Knowledge Assessment..... 259 Appendix N: Itemized summary of the posttest data ......................................... 264 Appendix O: The Skills Assessment items ........................................................ 267 Appendix P: The Graphing Proficiency items ................................................... 269 Appendix Q: Actual responses from participants in the one-to-one evaluation group ................................................................................................................... 270 Appendix R: A summary of the verbal responses from participants in the one-to-one evaluation group ............................................................................... 271 Appendix S: A summary of the small-group evaluation responses................... 273 Appendix T: LOGIS Java code.......................................................................... 276 About The Author ........................................................................................................... 277